Spectral Algorithms for Unique Games 

Alexandra Kolla* 



Abstract 

We give a new algorithm for Unique Games which is based on purely spectral techniques, 
in contrast to previous work in the area, which relies heavily on semidcfinitc programming 
(SDP). Given a highly satisfiable instance of Unique Games, our algorithm is able to recover a 
good assignment. The approximation guarantee depends only on the completeness of the game, 
and not on the alphabet size, while the running time depends on spectral properties of the 
Label- Extended graph associated with the instance of Unique Games. 

We further show that on input the integrality gap instance of Khot and Vishnoi, our al- 
gorithm runs in quasi-polynomial time and decides that the instance if highly unsatisfiable. 
Notably, when run on this instance, the standard SDP relaxation of Unique Games fails. As 
a special case, we also re-derive a polynomial time algorithm for Unique Games on expander 
constraint graphs. 

The main ingredient of our algorithm is a technique to effectively use the full spectrum of the 
underlying graph instead of just the second eigenvalue, which is of independent interest. The 
question of how to take advantage of the full spectrum of a graph in the design of algorithms 
has been often studied, but no significant progress was made prior to this work. 



'Microsoft Research. 
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1 Introduction 



A Unique Game is defined in terms of a constraint graph G = (V, E), an integer k which is called the 
alphabet, a set of variables {x n } ue y, one for each vertex u, and a set of permutations (constraints) 
k U v ■ [k] —> [k], one for each edge (u,v) G E. An assignment to the variables (labeling) is said to 
satisfy the constraint on the edge (u, v) £ E if ir uv (x u ) = x v . The edges are taken to be undirected 
and hence tt uv = (tt vu )~ ■ The goal is to assign a value from the set [k] to each variable X<u SO clS to 
maximize the number of satisfied constraints. 

Khot [Kho02] conjectured that it is NP-hard to distinguish between the cases when almost all the 
constraints of a Unique Game are satisfiable and when very few of the constraints are satisfiable: 

Conjecture 1. (Unique Games Conjecture-^ GC) For any constants e,5 > 0, there is a k(e,S) 
such that for any k > k(e,5), it is NP-hard to distinguish between instances of Unique Games with 
alphabet size k where at least 1 — e fraction of constraints are satisfiable and those where at most 8 
fraction of constraints are satisfiable. 

There are two reasons which make UGC particularly intriguing. First, it is a well-balanced question. 
Despite continuous efforts to prove or disprove it, there is still no consensus regarding its validity. 
This seems to indicate that UGC is more likely to be resolved in the near future in contrast to the 
P vs. NP problem for example, for which it is widely believed that P^NP but current techniques 
have been unable to prove it. Second, as seen by a series of works, the truth of UGC implies that 
the currently best known approximation algorithms for many important computational problems 
have optimal approximation ratios. Since its origin, UGC has been successfully used to prove often 
optimal hardness of approximation results for several important NP-hard problems such as Min- 
2Sat-Deletio n |Kho02j, Vertex Cover [KR03| . Maximum Cut |KKM()04] and non-uniform 
Sparsest Cut [CKK+06llKV05j . In addition, in recent years, UGC has also proved to be intimately 



connected to the limitations of semidefinite programming (SDP). Making this connection precise, 
the authors in |AuslO| and |Rag08 show that if UGC is true, then for every constraint satisfaction 



problem (CSP) the best approximation ratio is given by a certain simple SDP. 

Arguably, a seemingly strong reason for belief in UGC is the failure of several attempts to design 
efficient algorithms for Unique Games using current state-of-the-art techniques, such as linear and 
semidefinite programming (LP/SDP). Indeed, several works [KV05,RS09j show limitations of LPs 
and SDPs in solving Unique Games by exhibiting the existence of itegrality gap instances. Those 
are Unique Games instances that fool the SDP since, even though they have no good satisfying 
assignment, the respective SDP solution is high. The existence of such instances implies, in partic- 
ular, that there is no hope for a "good" approximation algorithm based on those SDPs. Moreover, 
recently it was shown that solving Unique Games is at least as hard as another seemingly hard 
problem called the small set expansion problem [RS10] . Our work presents evidence that a different 
set of techniques might be more powerful when it comes to designing algorithms for Unique Games 
thus giving hope that such techniques can be used to potentially disprove UGC. 

We present a purely spectral algorithm for Unique Games that finds highly satisfying assignments 
when they exist. The running time of our algorithm depends on spectral properties of the Label- 
Extended graph or the constraint graph associated with the instance of Unique Games. Our algo- 
rithm runs in polynomial or quasi-polynomial time for a large class of instances, including those 
where the standard SDP provably fails as well as instances where the constraint graph is an ex- 
pander. At a high level, we show that given e > 0, there is a 5 = 5(e) such that the algorithm is 
able to distinguish between the following two cases: 
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• YES case: There exists an assignment that satisfies (1 — e) fraction of the constraints. 

• NO case: Every assignment satisfies less that 5 fraction of the constraints. 

In particular, our algorithm runs in quasi-polynomial time on input the SDP integrality gap instance 
as it appears in K VP.")' (hereafter referred to as /CV). We note that the authors in |KV05| roughly 
showed that, when run on a certain highly unsatisfiable instance of Unique Games, the standard 
SDP relaxation has very high objective value and consequently fails to distinguish between the two 
cases above. As another special case, our algorithm runs in polynomial time when the constraint 
graph is an expander (therefore re-deriving results similar to |AKK + 08] and |KT07| ). Moreover, 
similarly to [AKK + 08irMM09tlKT07llAIMS09j . the performance of the algorithm does not depend 
on the alphabet size k. 

Our main result is the following: 

Theorem. (Main) Let IA = (G,M,k) be a (1 — e) satisfiable instance of Unique Games on a d- 
regular graph G with alphabet size k. Let M be the adjacency matrix of the label- extended graph of 
G. Let W be the space spanned by eigenvectors of M that have eigenvalue greater than (1 — j)d, for 
7 > 8e. There is an algorithm that runs in time 2°^7 dm ^ w ^ + poly(n ■ k) and finds an assignment 
that satisfies at least (1 — 0( J 8e + e)) fraction of the constraints. 

We also show a similar theorem for the special case where all the constraints are of the form T- 
Max-Lin and the graph satisfies some special properties. That theorem is then used to derive the 
above-mentioned algorithm for expanders. 

Our key contribution is a technique of effectively using the full spectrum and eigenvectors of the 
relevant graph rather than just the first few eigenvalues. Interestingly, prior to this work, researchers 
had often attempted to take advantage of the full spectrum of a graph in the design of approximation 
algorithms, but no significant progress was made. We believe that our techniques are of independent 
interest and could contribute to developing better algorithms for a number of other problems. In 
a recent breakthrough paper, Arora, Barak and Steurer [ABS10] used our main technique as a 
crucial building block in their sub-exponential time algorithm for arbitrary instances of Unique 
Games. Consequently, we believe that our results give evidence that spectral techniques might be 
a more powerful tool than SDPs for attacking and, potentially even disproving, the Unique Games 
Conjecture. 

1.1 Comparison to Other Work on Unique Games 

Several polynomial time approximation algorithms using linear and semidefinite programming have 
been developed for Unique Games on arbitrary graphs (see [Kho02 , [Tre05j, [GT06 , [CMM06a], 
[CMM06b]). These algorithms start with an instance where the value of the SDP or LP relaxation 
is 1 — e and round it to a solution with value v. Here, value of the game refers to the maximum 
fraction of satisfiable constraints. For v > 5, this would give an algorithm to distinguish between 
the two cases. However, most of these algorithms give good approximations only when e is very 
small (e = 0(1/ log n) or e = 0(1/ log k)) and their approximation guarantee depends on the 
alphabet size k Y}. For constant e, only the algorithm in [CMM06a] gives interesting parameters 
with v ~ k~ e /( 2 ~ £ \ We refer the reader to [CMM06a| for a comparison of parameters of various 
algorithms. 

1 It might be good to think of k as O(logn) since this is the range of interest for most reductions. 
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For some special cases of graphs, it has been shown that there are efficient algorithms that solve 
Unique Games. One such example is when the constraint graph is a spectral expander. In that case, 
the authors in [AKK + 08] (and later |MM09] with improved parameters) showed that one can find a 
highly satisfying assignment (with, say, v > 90%) in polynomial time. Notably, the approximation 
guarantee of their algorithm depends on the expansion parameters of the graph rather than the 
alphabet size. As another example, the authors in [AIMS09"] presented efficient algorithms for 
constraint graphs with large local expansion. 

Compared to the previous papers, our algorithm uses purely spectral methods as opposed to linear 
or semidefinite programming and runs in time that depends on spectral properties of the constraint 
graph or the label-extended graph. The approximation guarantee does not depend on the size of 
the graph or the size of the alphabet and thus our algorithm always finds a good assignment when 
one exists. We note that, in an unpublished manuscript, Kolla and Tulsiani |KT07| developed a 
spectral algorithm that runs in polynomial time and finds highly satisfying assignments on expander 
constraint graphs. 

1.2 Overview of Our Techniques: Recovering Solutions by Spectral Methods 

Our basic approach for the Unique Games algorithm is exhaustive search in a subspace spanned 
by several eigenvectors of a graph associated with the Unique Games instance. We identify a 
"good" subspace which contains a vector that "encodes" a highly satisfying assignment and then 
exhaustively search for this vector in (a discretization of) the subspace as we explain below. 

Let U be our Unique Games instance which is (1 — e) satisfiable. One can think of this instance 
as "coming from" a completely satisfiable instance U as follows: an adversary on input VI, picks 
an e fraction of edges and changes the constraints on those edges so that the resulting instance 
IA becomes (1 — e) satisfiable. Let M be (the adjacency matrix of) the graph corresponding to 
IA and M (the adjacency matrix of) the graph corresponding to IA. Assume, for simplicity, that 
these graphs are (i-regular. We first observe that a characteristic vector y a of a perfectly satisfying 
assignment a for IA is an eigenvector of M with eigenvalue d. 

We next consider a space W which is the span of the eigenvectors of M with eigenvalue very close 
to d and show that every characteristic vector y a is close to some vector in W (in £2 norm). 

Our algorithm simply looks at a set S C W of appropriately many candidate vectors and "reads-off" 
an assignment. 

Recover-Solution^W) 

• For each x £ S, construct an assignment L x by assigning to each vertex u, the index corre- 
sponding to the largest entry in the block (x u i, . . . , x u k) i.e. L x (u) = argmaxj x u {. 

• Out of all assignments L x for x £ S, choose the one satisfying the maximum number of 
constraints. 

To choose S, we identify a set of nice vectors N C W such that the above algorithm works for 
any vector v close to some vector in N . These are going to be the vectors that are close to the 
assignment eigenvectors. We then construct a set S C W of test vectors such that at least one 
vector v E S is close to a vector in M. S is simply an epsilon-net for W. Lastly, we go over all 
vectors in S until we find v. The running time of the algorithm will depend on the size of S which, 
for an appropriately defined epsilon-net, it is exponential in the dimension of W. 
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Certain "simple" graphs, including expander graphs and the Khot-Vishnoi instance, have only 
a few eigenvalues close to d and thus the dimension of W is small. Consequently, exhaustive 
enumeration in the subspace spanned by the corresponding eigenvalues will quickly find a good- 
enough assignment. 

1.3 Organization of the Paper 

The rest of the paper is organized as follows: in section [2] we give some preliminary notation and 
definitions that will be used in the rest of the paper. Section [3] contains the proofs of the main 
theorem above as well as of a theorem for the T-Max-Lin case. More specifically, we prove the 
main theorem in subsection 13.11 The proof of the theorem for the T-Max-Lin case appears in 
subsection 13.21 Subsection 13.31 contains the generalization of the main theorem for non-regular 
graphs. In section HI we analyze our algorithm when run on the Khot-Vishnoi instance. 

2 Preliminaries 

2.1 Spectra of Graphs 

We remind the reader that for a graph G, the adjacency matrix A = Aq is defined as 



We will also be dealing with weighted graphs, where edge (u, v) has weight w uv > and the adja- 
cency matrix is defined as Aq(u,v) = w uv . We will also assume, w.l.o.g. that w uv < 1 (if not, we 
just re-scale the weights of the edges by the maximum weight). If the graph has n vertices, Aq has 
n real eigenvalues Ai > A2 > • • • > A n . We can always choose n eigenvectors 71, • • • ,7n such that 
7i has eigenvalue \ which form an orthonormal basis of 1™. We note that if the graph is <i-regular 
(the total weight of edges adjacent to every node is d) then the largest eigenvalue is equal to d and 
the corresponding unit length eigenvector is the (normalized) all-one's vector. 

For a graph G, let D be the diagonal matrix with diagonal entry D(u, u) = Yl v -(u v)eE w uv equal 
to the degree of node u, namely the sum of the weights of edges adjacent to u. The Laplacian of G 
is defined as follows: 



If the graph has n vertices, Lq has n real eigenvalues = H\ < //2 < • • • < Mn- We can always 
choose n eigenvectors 71 , • • • , 7n such that 7^ has eigenvalue /Xj which form an orthonormal basis 
of W 1 . We note that is always an eigenvalue with corresponding unit length eigenvector the 
(normalized) all-one's vector. Moreover, if and only if the graph has k connected components, then 
Lq has k eigenvalues equal to zero. 



2.2 The Label-Extended Graph 

For a given instance of Unique Games on a constraint graph G = (V,E), let A be the adjacency 
matrix of G and let M denote the nk x nk matrix such that the k x k block M uv is equal to w uv Il uv . 
We use Ii uv to denote the k x k matrix of the permutation tt uv . Namely, 




L G = D - A G 
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1 ifir uv (i)=j 
otherwise 



Note that ir uv = (7r„ n ) -1 implies TL UV = H VU T therefore M is symmetric. We can view M as the 
adjacency matrix of the Label-Extended graph for that instance of Unique Games. Let k denote the 
size of the alphabet. We will denote this instance by U = (G, M, k). 



Definition 2. (Characteristic vector of a labeling) For any labeling of the vertices L — {L u 
with L u G [k] we define the characteristic vector of that labeling as the nk dimensional vector y L 
with 

L/ ■ \ / 1 ifi = L u 



otherwise 

We will often normalize such vectors to make them unit vectors. In this case, we have 

y L (u,i) = { ^ lf i = Lu 
I otherwise 

With some abuse of notation we will refer to both vectors as characteristic vectors of labelings 
whenever it is clear from the context. 

The following is an important observation: 

Observation 3. Assume that a certain instance IA is completely satisfiable. Namely, assume that 
there is a labeling L = {L u } u ^v with L u G [k] such that, for all (u,v) G E we have ir uv (L u ) = L v . 
Then the characteristic vector y L is a eigenvector of M with eigenvalue d, if G is a d-regular graph. 
It is also an eigenvector of the laplacian Lm with eigenvalue 0. 



2.3 T-Max-Lin Instances 



Let r be an abelian group. A T-Max-Lin instance of Unique Games on graph G(V, E) has for each 
edge (u, v) G E a constraint of the form x u — x v = c uv , where variables taking values 

in r and c uv G V. The alphabet k is the size of the group T. We note that if a pair of labels 
(L u , L v ) G r x r satisfies a constraint x u — x v = c uv of the above form, then for all i £ T, the pair 
(L u + i, L v + i) G r x T also satisfies the constraint. This implies that any labeling {L u } u ^v of 
the vertices of G is shift-invariant. Namely, for all i G T, the labelings {L u } u ^v an d {L u + i} U £v 
satisfy the same set of constraints. 



2.4 The Spectrum of Cayley Graphs 

For the purposes of this paper, we will use a generalized definition for Cayley graphs. For back- 
ground on the standard definition and properties of Cayley graphs see, for example, [Kas02,S pi09| . 



Definition 4. (Adjacency matrix of a Cayley graph) Let 0, be a group with n elements. The vertex 
set of a Cayley graph C(S7) is the group 17. The adjacency matrix of C(f2) is the n x n matrix 
A C(n) defined as follows: For g t ,g 2 G f2, ^^(51, 52) = /(ffi - 92), where "-" refers to the 
inverse group operation and f : Q — > M+. Note that the above definition allows C{Q) to have 
weighted edges, with the only constraint being that the weight of an edge between g\ and g 2 depends 
on their group -theoretic difference. 
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We note that the standard definition of a Cayley graph, given a set S of generators, is a special 
case of the above, where f(g% — 52) = 1 if 9i — 92 £ S and otherwise. 

For what follows, we will only be interested in $7 being abelian. In the rest of this section, for 
simplicity, we will identify a vector / in W 1 with the function / : $7 — > R and we will use the two 
interchangeably. 

It is well known, that for the abelian case ^4c(n) nas an eigenbasis that consists of the n group- 
theoretic characters Xg>9 £ ^- We remind the reader that every function / : Q — >• M can be 
written as follows: f(x) = ^2 ge Q f(g)Xg( x ) where f(g) is the fourier coefficient that corresponds 
to character Xg- F° r more background on characters and fourier analysis we refer the reader to 
standard algebra textbooks and surveys see, for example [Art91| . [Lin07j . |Kas02| . 
Since definition H] is slightly different than the usual, we present a proof of the following lemma for 
completeness. 

Lemma 5. Let C(f2) be Cayley graph of an abelian group Q, as in definition^ and ^4<7(Q) be ^ s 
adjacency matrix. Then for every g £ 0,, A c ^Xg = \^\f{9)Xg- Namely, every character Xg * s an 
eigenvector of and \Cl\f(g) is its corresponding eigenvalue. Here, with f we denote fourier 

coefficients. 

Proof. It is enough to prove the equality for each entry of Ac(p.)Xg-> that is for every vertex x E Q 
we will show {A c ^x g }x = \£l\f(g)x g (x)- We calculate: 

Yl A c(n)(%, y)x 9 (y) = ^2f( x ~ y)x 9 {y) = Yl f( z )x g (x)x g (-z) = Mf{g)x 9 {x) 

j/esi yen zesi 

□ 

2.5 The Khot-Vishnoi Graph 

In [KV05] . the authors considered the following family of graphs: 

For parameters n and e, let N = 2" and n = 2 k . Denote by J- the family of all boolean functions 
on { — l,l} fc . For f,g 6 T define the product fg as (fg)(x) = f(x)g(x). Let H = {xs\S C [k]} 
be the set of characters of the group FJ?. Consider the equivalence relation = on T defined as 
/ = g iff there is an S C [k] such that / = gxs- This relation partitions J- into equivalence 
classes V\ , • • • , V m , where m = ^- = ^— . For each equivalence class V% , we could pick an arbitrary 
representative pi &Vi, so that 

Pi = {PiXs\S c [k]} 

For < e < 1 let / G e J- denote a random boolean function on { — 1, l} k where for every x E 
{ — l,l} fc , independently, f{x) = 1 with probability 1 — e and f(x) = —1 with probability e. For 
the given parameter e and boolean functions f,g G T let 

wt £ ({/, <?}) := Pr f6l/aW [({/ = /'} A {g = /V}) V ({g = f'} A {/ = f'fi})] 
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The KLV n)t constraint graph with parameters n and e can now be defined to have vertex set 
V = {Pi,-- - ,P m }- For every f E Pi and g G Pj, there is an edge between the vertices Pi 
and Pj with weight wt e ({/, g}) 

We next describe the set of constraints. The set of labels for the instance will be 2^ := {S : S C 
[k]}, i.e. the set of labels [n] is identified with the set 2^ (and, thus, n = 2 k ). This identification 
will be used from now on. Let f £ Pi with / = piXs an d g G Pj with g = piXT for some S,TC [A;]. 
The constraint ir e for the edge e{/, g} corresponding to the pair of functions /, g can now be defined 

as 

tt^(T A U) = S A U, Vl7C[fc] 
Here, A is the symmetric difference operator on sets. 

We denote the label-extended graph of the instance described above with /CV n)£ . The graph 
ICV n ,e has vertex set { — 1, l} n . Between two vertices f,g£ {—1, l} ra there is an edge with weight 
n- wt e ({/, g}). 



It will be useful, for the purposes of this paper, to consider an equivalent definition of /CV n;£ and 
JCV n ,E, by translating to the {0, 1} language. Let H n = {0, l} n be the group FJ> with addition 
(modulo 2) as group operation. Let n = 2 k . Then the set H is the Hadamard code on n bits. 
Namely, 

H = {hy€ {0, l} ra , y G {0,l} fe |s.t. /^(x) = (x,y),x G {0,l} fc } 
Note that = n and H is a subgroup of H n . 

The graph /CV n)£ is just a Cayley graph of the quotient group of H n by H, namely of the group 
Q = H n /H. The vertex set V = {Pi, ■ ■ ■ ,P m } consists of the ^ cosets of H. For every / in the 
coset Pi and for every g in the coset Pj , there is an edge between the vertices Pi and Pj with weight 
wt e ({/, g}). For simplicity of notation, we will identify the cosets with their representatives, i.e. 
if x = Pi is a vertex of JCV n ,e, then we will use x to refer both to the coset Pi as well as to its 
representative pi. 

The total weight of all the edges between two cosets x = P% and y = Pj is 

A(x,y) = ^2 e'^ +9 '(l - e) n ~'^ +s ' = ^ e \x+hi+y+h 2 \ ^ _ e ^n-\x+hi+y+h2\ 

feVi,geVj hi,h 2 eH 
Note that the graph is n-regular, namely the total weight of edges adjacent to any node x is 
X X e\' x+hl+y+h2 \ (1 - g^-N+fri+^+H = n e | a+y+ / t2 ^ 1 _ ^ n -\ x+y+h2 \ 

yeQhiM^H yeQh 2 £H 

= n J2 e^(l-e) n -^ =nJ2( n \ i (l-e) n - i = n(l-e + e) n =n 

zeH n i=o 

The label-extended graph /CV„ i€ is a Cayley graph of H n , since for every two vertices u, v G {0, 1}™ 
we have that the corresponding entry of the adjacency matrix of KLV n ,e depends only on the hamming 
distance of u and v, or, in other words, onu — v = u + v (modulo 2). Moreover, K,V n ^ can be 
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described as an "e-perturbed" version of the standard hypercube graph: the weight between two 
vertices u, v 6 {0, 1}™ is proportional to the probability that if one starts from the n-bit string u 
and flips each one of its bits independently with probability e, then one gets the n-bit string v. 
The following appears in [KV05]. We give the informal statement here, for simplicity. We refer the 
reader to [KV05] for the full statement and details. 

Claim 6. (Integrality Gap for Unique Games, Informal Statement) Let n be an integer and e > 
btzji parameter. Then for the instance of Unique Games described above, with label- extended graph 
/CV„ )£ the following hold: 

• Every labeling L : V — > [n] satisfies at most a ^ fraction of the total weight of the edges. 

• The standard SDP relaxation for Unique Games has objective value greater than 1 — 9e. 

2.6 Additional Notation 

For simplicity of the presentation, we will assume that G is a regular graph, namely w uv = d 
for all nodes u. At the end of the next section, we show that the results can easily be generalized 
to non-regular graphs. 

For the sake of convenience, in the rest of the paper we will often use the term eigenspace to refer 
to the space spanned by a set of eigenvectors that don't necessarily have the same eigenvalue. The 
relevant set of eigenvectors that span this space will always be clear from the context. We use 
poly(n) to refer to some polynomial function in n. 

We also use the following notation for the time needed to compute eigenvalues and eigenvectors: 

Definition 7. Let U = (G, M, k) be an instance of Unique Games on a graph G on n nodes and 
with alphabet size k. Let M be the adjacency matrix of the label- extended graph of G. Let W be 
some space spanned by eigenvectors of M . We denote by Ty/{M) the time needed to compute an 
eigenbasis and the corresponding eigenvalues ofW. Note that T\y(M) is polynomial in the dimen- 
sion of M, namely Tyy(M) = poly(n ■ k). 

We also note that in the rest of this paper we use the terms "assignment" and "labeling" inter- 
changeably. 

3 Recovering Solutions by Spectral Methods 

In this section, we will show how, given a (1 — e) satisfiable instance of Unique Games IA = (G, M, k) 
on graph G and with alphabet size k, the eigenvectors of the label-extended graph M may be used 
to recover good assignments. Specifically, we show the following: 

Theorem 8. (Main) LetlA = (G,M,k) be a (1 — e) satisfiable instance of Unique Games on a d- 
regular graph G onn nodes with alphabet size k. Let M be the adjacency matrix of the label- extended 
graph of G as above. Let W be the space spanned by eigenvectors of M that have eigenvalue greater 
than (1 — j)d, for 7 > 8e. There is an algorithm that runs in time 2°^7 dtm ( w ^ + poly(n ■ k) and 
finds an assignment that satisfies at least (1 — 0( J 8e + e)) fraction of the constraints. 
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In particular, the theorem implies that for small enough e, for every 1 — e satisfiable instance of 
Unique Games that satisfies the assumptions of the theorem, one can find an assignment that 
satisfies more than 90 percent of the constraints in time that depends on the spectral profile of M. 
We also remark the following: 

Remark: If the algorithm of theorem [8] fails to find an assignment that satisfies at least (1 — 
0( J 8e + e)) fraction of the constraints, then for the input IA, every assignment satisfies less than 
(1 — e) fraction of the constraints. Here, the constant in the O(-) notation is the same as the one 
guaranteed by the theorem above. 

We also consider the special case where the constraints are arbitrary T-Max-Lin. For such con- 
straints, we prove theorem [9] below. 

Theorem 9. Let U = (G, M, k) be a (1 — e) satisfiable I '-Max-Lin instance of Unique Games on a 
d-regular graph G on n nodes with alphabet size k. Let <SVi_ 7 ) be the space spanned by eigenvectors 
of G that have eigenvalue greater than (1 — j)d. Assume moreover that every unit-length vector 
<fi G 5'(i- 7 ) has II^Hoq < for some constant C . Then, for 7 = £l(^/e), there is an algorithm that 

runs in time 2°( k ' Ds ^ + poly(n ■ k) and finds an assignment that satisfies at least (1 — C) fraction of 
the constraints for some £ = 0(y/e). Here D$ denotes the dimension of <SVi- 7 ) and the constant in 
the O(-) notation depends on C . 

Assuming that Tjg (1 _ . (M) < 2 0<yk ' Ds ^ the algorithm in theorem [9] has running time that solely 
depends on the spectral profile of G, since roughly, the space of eigenvectors of M with large eigen- 
value has dimension equal to k times the dimension of the corresponding eigenspace of G. 

The result for expander graphs as it appears in |KT07j can be derived as a corollary of theorem [9j 

Corollary 10. (Unique Games are Easy on Expanders) LetU = (G,M,k) be a (1 — e) satisfiable 
T -Max-Lin instance of Unique Games. Assume moreover that G is a d-regular spectral expander 
on n nodes. Namely, the second eigenvalue of the adjacency matrix of G is A < (1 — y)d, for 
7 = Q(y/e). Then, there is a polynomial time algorithm that finds an assignment that satisfies at 
least (1 — Q fraction of the constraints for some £ = 0(y / e). 

Proof. The eigenspace S7i_ 7 ) of theorem [9] consists solely of the all l's vector. The ioo norm 
assumption is trivially satisfied with C = 1. Then, the conclusion of the theorem implies that 
for 7 = ri(- v /e), there is an algorithm that runs in time 2°( fc ' 1 ) + Ts, t _ AM) = 2°^ + poly(n • k) 
and finds an assignment that satisfies at least an 1 — O(^) fraction of the constraints. By the 
statement of the Unique Games Conjecture, it is enough to consider k to be at most logarithmic 
in n. Therefore the algorithm runs in 2°( logn ) + poly(n • k) = poly(ra) time. □ 

We remark that the T-Max-Lin requirement is necessary for corollary [101 The proof fails to pro- 
duce similar guarantee for the general case. This is due to the fact that the spectral properties of 
label-extended graphs that correspond to arbitrary Unique Games are poorly understood. 



3.1 Proof of Theorem [8] 

We prove theorem [8] by combining two facts. First we show that characteristic vectors of good 
labelings have large projection onto the eigenspace of M spanned by eigenvectors with large eigen- 
values. Then we show that if M has at most D large eigenvalues then we can find a vector close 
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(in ^2-norm) to such a characteristic vector of a labeling in time exponential in I?, by looking at an 
appropriate epsilon-net for this eigenspace. Our proof is inspired by the approach that the authors 
in the unpublished manuscript [KT07| used in order to recover satisfying assignments on expanders. 

Proof Overview. Assume we are given a (1 — e) satisfiable instance IA = (G,M,k) that satisfies 
the assumptions of theorem [SJ We define a completely satisfiable game IA = (G, M, k) (with value 
1) that "corresponds" to U as follows: 

Definition 11. (Completion of a Game) Let IA = (G,M,k) be as above and let C = {L(u)} be 
an assignment that satisfies (1 — e) fraction of the constraints. Let e = (u,v) be an edge with 
constraint x v = tt uv (x u ) that is not satisfied by this assignment, with labels L(u), L(v) on its 
endpoints. Construct a new game by changing the constraint on every such edge e = (u, v) by 
replacing tt uv with a permutation tt uv for which tt uv (L(u)) = L{v). Let U = (G,M,k) be this new 
completely satisfiable game. We say thattl is a "completion" ofU. 

For the sake of the proof, we will assume that an almost satisfiable instance IA = (G, M, k) is 
constructed as follows: 

• Let IA = (G, M, k) be a completion of IA. 

• Let an adversary pick the e fraction of edges that were unsatisfied in U and change their 
constraints back to the original ones. We can now think of M as a "perturbation" of M and 
U "perturbed" game of IA. 

Let W be the span of the eigenvectors of M with eigenvalue at least (1 — j)d, for some 7 > 8e. The 
algorithm simply looks at a set S C W of appropriately many candidate vectors and "reads-off" 
an assignment. We describe later on how to choose the set S. 

Recover-Solution^ (IA) 

• For each x £ S, construct an assignment L x by assigning to each vertex u, the index corre- 
sponding to the largest entry in the block (x u %, . . . i.e. L x {u) = argmaxjX u j. 

• Out of all assignments L x for x G S, choose the one satisfying the maximum number of 
constraints. 

To choose S, we look at the highest eigenvectors for the matrix M. Those are the assignment 
eigenvectors, namely the characteristic vectors of the (perfectly) satisfying assignments of IA (since 
they all have eigenvalue equal to d). We will first observe that every such eigenvector y is close to 
some vector in W, and the length of the projection of y onto W depends on e, 7. We then identify 
a set of nice vectors N C W such that the above algorithm works for any vector v close to some 
vector in J\f. These are going to be the vectors that are close to the assignment eigenvectors. We 
then construct a set S C W of test vectors such that at least one vector v S S is close to a vector 
in M. S is simply an epsilon-net for W. Lastly, we go over all vectors in S until we find v. The 
running time of the algorithm will depend on the size of S which, for an appropriately defined 
epsilon-net, it is exponential in the dimension of W. 

3.1.1 Eigenspaces and Labelings 

Our first step is to identify an appropriate eigenspace W of M such that characteristic vectors of 
good labelings have large projection onto W. 
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For the matrix M, let C = {L(u)} ueV ( G ) be a completely satisfying assignment. Define vector 



as 



yj c) = i ^ 



4= if i = L(u) 
otherwise 



It is easy to see that is an eigenvector of M with eigenvalue d. Since y^ corresponds to the 
satisfying assignment C, it can be seen as the characteristic vector of the assignment. We refer to 
such vectors as the "assignment" eigenvectors. Our next goal is to show that, for some appropriate 
choice of 7, the eigenspace W contains vectors close to an assignment vector. 

Claim 12. ( Closeness) For every completely satisfying assignment C there is a unit vector vc G W 
such that vc = ay^ + f3y^j_, with a > and \f3\ < \J^- Here both y^ and y^± are unit 
vectors and y^± -L y^ ■ By taking, for example, 7 > 200e ; we have \/3\ < j^. 

Proof. We can easily see that (y^) T My^ > d(l — 2e). We can now write = avc + b(vc)±, 
with a > 0, vc € W and (vc)± € W L . We calculate: 

(1 - 2e)d < (y ic) ) T My( c) = a 2 (vc) T Mv c + b 2 ({v c )±) T M(v c )± < a 2 d + 6 2 (1 - i)d 
from which we get that |6| < \ ~~ . 



Now, we can in turn express vc = ay^ + fty^ ± , where a = (vc,y^) = a = \/\ — b 2 > ^jl — ^ 
or, equivalently, |/3| = \f \ — a 2 < \/ 2 f- □ 



We have now managed to show that there exists a set of "nice" vectors N = {vc} Q W. 
The next claim shows that, if we knew the vc's then we could set S = N and the algorithm 
Recover-Solution_v"(^/) would return a highly satisfying assignment for U. 

Claim 13. If x is a vector such that x = ay^ +/3y^± for some y^ with a > and y^± _L y^ c \ 
then the coordinate is maximum in absolute value in at least (1 — ^§r) n blocks. 

Proof. Within each block u, in order for coordinate L(u) to be no longer the maximum one, it must 
happen that for some j 

4+^ (£) iW)<^ £) 



However, this gives 



[(y {c \) uj - (y (c) ± ) U L(u)] 2 > 
2(y (c) ± )l, + 2(y^ ± )l L{u) > 
(y {c) ±)u 2 > (y (c \)l, + (y (c \) 2 uL{u) > 



/3 2 n 
a 2 



fi 2 n 

„2 



2/? 2 n 

Since lly^jll = 1, this can only happen for at most blocks. □ 
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3.1.2 Eigenspace Enumeration: Finding the Set S of Test Vectors 



Our next step is to show that the search for a good assignment can be done in time exponential to 
the number of large eigenvalues of M, namely the dimension of W. 

Since we don't know the y^' (if we did, we would be done), and the space W contains infinitely 
many unit vectors, we cannot identify N . To get around this, we discretize W with an appropriate 
epsilon-net. If we let w^°\ . . . , 7/;( dim ( w/ ) _1 ) be an eigenbasis for W. We define the set S as 

(dim(W)-lj / 



s=0 



a ° w(s) 1 a °^^tiw)^ IH| - 1 



It can be calculated (see, for instance [FO05| ) that the number of points in the set S is at most 

20(^dim(W)) 

To conclude the proof of theorem [8j it remains to show that S has a vector close to a nice vector 
vc G A/". By construction, S contains at least one vector close to every vector in J\f and thus it also 
contains at least one vector v such that v = avc + (3(vc)± for some C and |/3| < \ —■ Together 



with claim [I~2| this implies that we can also write v = ay^ + by±"\ with |6| < y^f + y^f = ^"\fj' 
Thus, by claim [T3"l for this vector v, Recover—Solutions^) recovers an assignment which agrees 
with y^> in (1 — O( rjgg )) fraction of the blocks. 

We will consider that a constrain is violated if one of the two following events happen: either 
the assignment we recovered does not agree with the initial perfectly satisfying assignment or the 
constraint is one of the (at most) e fraction of constraints that were changed. It follows that 
the assignment which we recovered, violates constraints on edges that have total weight at most 
0( 7 _! 8e )n.<i + end. Since the total weight of constraints is nd/2, theorem [8J follows. The algorithm 

runs in 



3.2 Proof of Theorem d 

Let 6 > such that 7 > 6 > 0(67). Let W be the span of eigenvectors of M with eigenvalue 
at least (1 — 9)d. Let Y be the span of eigenvectors of M with eigenvalue at least (1 — ^y)d. In 
particular, Y contains all the assignment eigenvectors, namely the characteristic vectors of the 
(perfectly) satisfying assignments of U (since they all have eigenvalue equal to d) . Let Y± be the 
orthogonal complement of Y. 

For the proof, we will use theorem [8J together with a bound on the dimension of W. Roughly we 
show that the dimension of W is at most as large as the dimension of Y which, in turn, is at most 
k times the dimension of 5'(i_ 7 ) . To conclude, we apply theorem [8j for the eigenspace W. 



We will assume w.l.o.g that the graphs we are dealing with are connected. Otherwise, we apply 
the results to each connected component individually. 

Definition 14. Let $ be an eigenbasis for G. For every eigenvector <j) = ((j)u)u£V € $ let <fi to 
be the kn- dimensional vector <p u i = <j) u , for i = 1, • • • ,k. Due to shift invariance, there exist k 
satisfying labelings of the unique games instance which we denote by Li,i = 1, • • • ,k. Let y( Li > be 
the characteristic vector of labeling Li and let £(4>) = {<ft ■ y^ Li '\ for i = 0, • • • ,k — 1}. Here ■ 
denotes entry-wise vector product. We define the following set of k x n vectors: = U < Ae*^( < ^)- 
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We note that the set $ consists of orthogonal unit vectors, since every two vectors in $ have disjoint 
support. The next observation immediately follows from the fact that, due to the shift-invariance 
property of T-Max-Lin instances, M is the adjacency matrix of k disconnected copies of G. 

Observation 15. $ is an eigenbasis of M . Consequently, the dimension of Y is at most k ■ D$, 
where D$ is the dimension of Sn^.~\, as per the assumption of the theorem. 

Lemma 16. Assume 7 > 9 > f2(e7) for some appropriately large constant. Then any unit-length 
vector w £ W can be expressed as ay + f3y± where y £Y and y± E Y± are both unit length vectors, 
and \P\ < O(yf^). By taking, for example, 7 > Q(\/9) and, consequently, 7 > 0(-y/e), we get 

\P\ < I- 

Combining claims [15] and [TBI we can proceed as follows: From claim [16] we obtain that W has 
dimension dim(W) < dim(Y). Otherwise, we would find a vector orthogonal to all the vectors in 
Y which cannot be close to their span. From claim [151 we obtain dim(y) = k ■ Dg. 
To conclude the proof of theorem [9] we apply theorem [8] with W being the (at most) k ■ D$ 
dimensional eigenspace of M with eigenvalues > (1 — 6)d. 

Finally, it remains to argue about the running time of the algorithm. Since dim(W) < k ■ D$, 
the number of points is exponential in kDg- Hence, the algorithm runs in 2°( k ' Ds ^ + Tw(M) = 
2 0(k-D s ) + po iy( n . k) time. 

3.2.1 Perturbation of Eigenspaces: Proof of Claim 1161 

We next prove claim [T6] Towards this end, we will apply some results from matrix perturbation 
theory. To find appropriate 7 and 9 such that the eigenspaces W and Y are close, we use the 
following claim which essentially appears in [DK70] as the sin 9 theorem and was used in |KT07j . 

Lemma 17. Let w be a unit length eigenvector of M with eigenvalue A > (1 — 9)d, and let X s 
denote the largest eigenvalue of M which is smaller than (1 — j)d. Then, w can be written as 

1 . (M— M)mj I -77 

ay + py± with \p\ < " ^ A _ A ^ . Here y S Y and y± S Y are unit length vectors. 

As seen by the previous lemma, in order to prove that the space Y does not change by much 
due to the perturbation, we simply need to bound (M — M)w . We will need the fact that w is 
somewhat "uniform" across blocks. To formalize this, let w be the n-dimensional vector such that 
Wu = II^mII where w u is the /c-dimensional vector (w u i, . . . ,w u k) T . We then show that w is very 
close to a vector in Sn^y 

Claim 18. If w is a unit-length eigenvector of M with eigenvalue more than (1 — 9)d and w as 
above, then we can write w as w = acf) + b(j)± with \b\ < ■J^ and tfr G 5(i_ 7 ), (j)± £ S^_^, both 
having unit length. 

Proof. Since, w corresponds to a large eigenvalue, we have that 

(l-9)d < {w) T Mw = w u T A uv ■ IL uv w v < y~] \\w u \\A uv \\w v \\ = (w) T Aw 



14 



Here the second inequality follows from the fact that the operator norm of U uv is at most 1. Writing 
w as cup + b(p± , we get 

(w) T Aw < a 2 d + b 2 {l-~/)d 
=>(l-6)d <a 2 d + b 2 (l-~/)d \b\<J- 
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□ 



Using the above, and the fact that the matrix M is only perturbed in e fraction of the edges, we 



can now bound 



(M - M)w 



as follows. 



(M - M)w < O (yff) d 



Claim 19. 



Proof. Define the n x n matrix R as R uv = w uv < 1 when the block (M — M) uv has any non-zero 
entry, and R uv = otherwise. Note that if (M — M) uv is non-zero, then it must be the (scaled) 



difference of two permutation matrices. Thus, for all v we have (M — M) uv w v 
calculate: 



\\w v \\. We 



(M - M)w 



Y,{M-M) 



< 



< 



yj(yj|(M-Ao„„a>„|) 

u \ v I 



\ U \ V 



\W V 



= 2 \\r™\\ 

To estimate H-R^H, we break it up as 

\\Rw\\ < \a\ \\R(t>\\ + \b\ \\R<P ± \\ 

Since each row of R has total sum of entries at most d, \b\ \\R(p±\\ < J ^-d. Also, 



ii^ii = ./EiE^^i^a e (e^i^i) ^ -%\ e (e^) 

V U V \ U \ V / * \ U \ V J 

Since R has a total sum of entries at most end, this expression is maximized when it has d Is in en 
rows. This gives \\R(f)\\ < C^fed. And, putting everything together we obtain 



(M-M)w < 2C^d + 2 x l-d < () \\ 7 I 



We note that the O(-) in the above expression depends on C. We obtained the last inequality by 
using the assumption of the lemma 6 > fi(ej). □ 
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Combining the above bound with claim [T71 we get that any unit-length vector w £ W can be 
expressed as ay + f3y± where y GY and |/3| < 0(^f^d ■ (1 _ ] d __ x )• Recall that X s was smaller than 
(1 — 7)(f, which implies 




^ ° I \l--—rA 

To conclude the proof of claim [TBI we take 6 << 7. We calculate: 

m<o(^-^-]<o(M) (2 ) 




It is sufficient to consider 7 > £l(\^6) and observe that this also implies, by the assumption 9 > 
n(ej) that 7 > n(^/e). 

3.3 Generalizing to Non- Regular Graphs 

It remains to show that the above results hold for non-regular graphs. We will consider eigenvectors 
and eigenvalues of the Laplacian matrix of the label-extended graph. Let G and M as before. Let 
D be the nk x nk diagonal matrix with block D uu = deg(u) ■ 1^, where Ik is the k x k identity 
matrix. The Laplacian of the label-extended graph is the matrix Lm = D — M. Let d be the 
average degree of G, and therefore of M, namely d = — - . 
We re-state the main theorem [8] to capture the non-regular case. 

Theorem 20. Let U = (G,M,k) be a (1 — e) satisfiable instance of Unique Games and W the 
eigenspace of Lm with eigenvalues less than 'yd, for 7 > 8e. There is an algorithm that runs in 
time 2 0<y ~ dtm<yW ^ + poly(n ■ k) and finds an assignment that satisfies at least (1 — 0( 7 J 8e + e)) 
fraction of the constraints. 

Proof. Let W be the span of the eigenvectors of Lm with eigenvalue less than 7c?, for some 7 > 
8e. We again recover highly satisfying assignments using our algorithm Recover— Solutions^). 
Similarly to the previous section, the set S C W will be a discretization of our new W. 

All we need to show is the following analog of claim [T21 We use the same notation as in section 13.11 

Claim 21. For every completely satisfying assignment C there is a unit vector vc £ W such that 
v c = ay(^ + f3y^j_, with < ■ Here y^ and y^± are both unit length vectors and 
y^± _L By taking, for example, 7 > 200e, we have |/3| < j^. 



Proof. (Of Claim) 

t q r r It a n cei/rn rn onrtf oi rfomropfrirc n 1^ a ra 01 n'omropf Arc /-if 



We first observe that the assignment eigenvectors y c are eigenvectors of Lr? with eigenvalue 0. 



We next see that 



(y^) T L M y {C) = {y (C) ) T {D - M)y<& = (y {C) ) T (D -M + M- M)y^ 



(yW) T (M-M)yW< =2ed 

n 
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We can now write y^' = avc + b(vc)±, with vc and (vc)± €. W 1 - . We calculate: 

2ed > (yW) T L M yW = a\v c ) T L M v c + b 2 ((v c )±) T L M (v c )± > b 2 7 d 
from which we get that \b\ < \/^- 



Now, we can in turn express vc = ay^ + /3y^±, where a = (i>£, Jr = \a\ = \/T — b 2 > ^/ 1 — ^ 



or, equivalently, \/3\ = a/1 — a 2 < •»/ ~. □ 



To conclude the proof of the theorem, we observe that the analog of claim [13] follows immediately. 
We define S as in section 13.1.21 namely 



(dim(WO-l) 

V = 

s=0 



□ 



7dim(W0 ' 

where are now eigenvectors of our new W . The theorem follows. 

4 Solving Unique Games on the Khot-Vishnoi Instance 

In this section, we show that, when run on the Khot-Vishnoi integrality gap instance, our main 
algorithm runs in quasi-polynomial time and correctly decides the (un) satisfiability of the instance. 
Namely, we show the following: 

Claim 22. Our main algorithm (as in theorem^) when given input the integrality gap instance of 
Khot and Vishnoi as described in the preliminaries section, with label- extended graph KLV n)t , runs 
in time n poly ( logn ^ and correctly decides that the instance is highly unsatisfiable. Here N = 2 n the 
number of nodes of H n and n is the alphabet size. 

The proof goes by showing that the eigenspace W as per theorem [8] has relatively low dimension. 
The theorem guarantees that exhaustive search in W would find a good assignment if such as- 
signment existed and consequently, failure to find such an assignment, will correctly classify the 
Khot-Vishnoi instance as unsatisfiable. 

The rest of this section is devoted to the proof of claim [22j We use the equivalent definition of 
/CVn i<E as a Cayley graph of H n which is an "e-perturbed" version of the hypercube graph. We will 
need the following claim for the spectrum of K,V n ^ e . We denote the adjacency matrix of K,V n ^ by 
M/cy 

Claim 23. The following is true for the spectrum o//CV nj£ . 

• The eigenvectors are the characters of the group H n . 

• The eigenvalue that corresponds to \w is (1 — 2e) r n, where r = \co\ is the hamming weight of 
ui, and appears with multiplicity C r = (") . 
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Proof. The first item above is immediate from the definition of the graph as it appears in the 
preliminaries section. 

For the second item, we just need to calculate the eigenvalues corresponding to Xu> or i equivalently, 
the quadratic form 



x,yeH n 

1 E xMW x+ y\(i-e) n -^xM) 



x,y£H, 

I 

2~ 

x,y&H n 

= E xU^ lz Ki - e) n ~ lzl 

n 

= nlW [*,,(*)] =l[E Zimi} [(-ir^} = n(l - 2e)M 
i=i 

To conclude the proof, we need to argue about the multiplicity of each eigenvalue or, equivalently, 
the number of characters Xu> °f a given hamming weight r. It is easily seen that there are C r = (") 
characters of H n that correspond to hamming weight r. □ 

We will directly apply theorem For this purpose we need to calculate the dimension of the 
eigenspace W of lCV n>e for some appropriate 7 > fl(y/e). 

Lemma 24. Let 7 = Cy/e for some sufficiently large constant C . The dimension of the eigenspace 
W of the graph KV n ,e with eigenvalues > (1 — 7) is at most Dyy < -n°^ = poly(n) = poly(log N). 



Proof. We first need to identify an upperbound on r such that (1 — 2e) r < (1 — 7), for 7 = Cy/e. 

log 1-7 
log l-2e 



It is enough to take r = ■ I n order to approximate r, we use the Taylor series expansion: 



log t— = E ~ 

1 — x 1 

i=l 



And for e, 7 small enough we get 



log 1 - 2e loe 



l-2e v 

for some appropriately large constant C. The dimension of W can now be bounded, using claim [ 
as follows: D w < Zr=o C) < \n°^ . □ 

We conclude by arguing, according to theorem EJ that our algorithm will run in time bounded by 
2 d w = 27-"° ( ^ = Ni-Qog*0°& = NtodyQtvN)). It will fail to find a highly satisfying assignment 
and thus decide that the above instance is highly unsatisfiable. Here we used the fact that for the 
graph in question, T Sw (M) < 2 Dw . 
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